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[#fT»#©$SB] 
©#- h t. 

^nty*Tll*Sftft^ HI — yy^fAgttSo 
T> 

— !f*6»J6*nfc*RO#'J ->-©<!>&< fct>— ^Sr 
ITS, 

«E^ni:yU-J4. ME**©* v h 

(WEtIft©*y h 7-* ©4>&< £fc— 

>y k &mm> i7-$. s^x?-©^©^^ £ 
e. 

[»#*3] aft** 1 E3£©X h- Iz-i'yXTAgaT 

e, t>t^©#- h £3*51" S*» £* o fr^tefeTZ X 

-fe-y bTSX hU- yxXfASI. 

[»#JS5] « 3 M'-y y^f ASBT 

*oT. IKIEttte*** 1 . &fflRTfi, — «P««ffl*ltB. 
R^ffl^Ffig©'>^t< £fc— Od^figSX M/-yy^ 

[»#JS6] »Mlffit®XH/-y^TAgiT 
*ot, igjp'Jy-^, PEfMi. S^ffl, S/hfit. ¥ 
W Hit. SMS. RtfB«©*l>&< £ 

fe-o^e.fi!c57 h l/-yyXfA81. 

Sot. 

iWE*I85c©*-y 1^7-^*5. tt&W/lxyjl/-^^ 



•y h^-^tCjfchfc-tSX h !/-7->XfAgt. 

©#Ua-AO'>&<tfe lo^e»fi£-S>X h v>->X 

[«*319] §8**8 E«©X H/— yyXfAgBt 

WI3S»«)J|fJa-AO'>a< £*> 1 ME«&© 

h9-^©7£1lXrtW6J2*VT^-£>X h U-v->X 
fAli. 

10] XM/-yS1^7H7-^MIt 
5*©3^h*i*tt«*jtT*^T. WE7jS«. 

£. 

£, 

fit iiB*l©$-)'h7-yS«ILTf- 

m&mi i] »#jsi ot5«©7jffiT*oT« 

t9ESfll©*>y h9-f©«IB3a«i»e«l»*»Sb&< 

Ktttt£m**SUi*3«k'5l::fcftfcf. WEM 1 ©*-y 
h !7-f tftffl bT©f -i'lEHICRt ^ t. **&fiJc* 

[flt$gil 2] »#JS1 0E«©yj&{C*3^T. 

[»#JH1 3] mim. \ OfB«©7jffi{C*5V^T. 
MESS 1 v h 7-* icw-j- SfldE$iJ*5©Jt^^. X 
^-7*7 K figffl^. 17-$, &Z>*X7-©#SE©{j> 

CW**1 4] fjfJfcJgl 0f2®©7jtetC*5^T, 
AftEJSl h7-y^. /^'J-y^^-y t-7-yT* 

&*3. ifB12©^7 h7-yH7 , 7^^-H*7 h7 
-v-Ta&Syjffi, • 

5] ffi#Jll Of2S©7jffi^i3^T. 
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ISO**; h7-?oa*0«l«)'>a:< tt>-oSt 

fc, ^©o.— tffi^TptJ z/-<D'Ptz< t<b—-otitm 
WK«** y h "7 - * Sel^ b T n £ h t 5 ©'> 

->-©^a< tt)-^st otv^m 

h7-*fc»ttbTl/>**R#-h4>©*l>£< t 

IWE«R#'J v-©4>&< fcfc-Ote, 
-?<D>)>U< tt>— ^K***fi:-r**JS. 
[Sl*«2 0] W*3«l 7JE«0*ffiC*«riT, 

[0 0 0 1] 
[0 0 0 2] 

i o o oifejifc&^-rrau 3i€-2)^^ 

nt^S. in AT. **©ifl:tt4«mLfc*WBEfB#© 

=FE£t>fce>bT^£>. z\(Dftn>, g><<Dfemt.. urn 



[0 0 0 3] iJ^E-hntr— tt, XM'-y^'Ja-A 

■/•>XfA <h U h *fc«-tr* >^U 7. h l/-y->X 

h b-^vX^AteSVMCfr&OCDgggtSrPlTTlS: 
STS^ffiJtES. ^CD20<D5 ; -rx^->X^Att^.-y 

ftJl/X'f X^xX^A^roHff^^U^:- hf-f X^ 

y^fAi:i?Sn5. ^Bfil ^RcD^-f 

h9 — ^Jl^OOiJt- hnbf— /HX h L — >>->X-rA 

mx% ffittWfcfctfifBT?**. teO^ 

[0 0 0 4] A*>*>£\ 77^t>X, «t^«^»« 
T©^->7-f>- h7>+)-*^->3 >5aS(0LTP)(Oj;5^: 
fv^XT^aica^Tyj^r-v'a >T«, i«j£b 

Mt!i5. ffi©^-f7"ff)77*Uy-y3X 0>JAfc£, 
WEBS 7 — U>^. f-^9X7A9X, T ; -^-fe>^ 
n>V Ux-->3 >. zfcfi^— ^fcai^K^TW:. — 

fce6, ±f2cD£5&S*tt ;; FgT&£. 
[0 0 0 5] Itt©Ut-H3(f-SiTt), ffiAMCafe 

sa©ffitei4tt-TTc®ifi$tiT^>**«, £&-£>&&© 

[0 0 0 6] 

[»W)!f*b±5iT51H] b*»bfra«e>. U€- 
hntf-a— tftcfcoTtt, 31ffl±©$fJffi^-H-SbTT 

*<flJffiT&-5. «BJA«. WEBS 7 — U >tf7~?*) 'T—ls 
a >Ttt-r >*—*y h&mmLx, A'>+>^©0LTP 

i7 7 y 7m «T?X h b- v'SrfiJffl b fc H tf \Z tt^B# 
SIKMtL&H. b^b^A^e., SE5l5CDSWT«, 

mm mmm\z& s^-^tea-y— t*x t ^ -tx^© 

M-b*Tfe-5. 
[0 0 0 7] CCD*«. — -yr\Zii -jTIl afi^lk^ 

^e- sx h^-^iz^m^n^^-^izy 
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60«Pi:»LTfi»sn, J: ft 

[0008] juigsRsn&Sflm, ^-fTUtut 
*Mr-a*asftfc8*"e**. *3B9itt. 

[0 0 0 9] 

*yh<7-*tt, ttffi. *^tt. AMtt. Iktt 

mm. «w#. Rt;ftHf«f»©«fflsii*K« 

UT. l&Mt^^v b 1 ?— Z&miZTZZiiWSJffilZ 

Afc.fi/Ott. SMfSVyT^T^-trXLT. mm nSffifc 
fc*Uy-l:!pIH^5. 

[ooio] i t>©tt*«&*i60iJ-m. ^-fvux 

5MB/s©»*>Ul'-:/v h£<fe£*-y b7—9\zmi£(.ffl 
W)-?Z>t. 7 , 5-f7UXM/-yyXfAll -?-©l& 
BftTLa^g^y h"7-:?£ffifflb&H. 5MB/s©fE 
IMSfCjiTixh. ^7^7UXH/-^yXfAH <te 

s-r. 

[ooii] Hicftfi©SiS£0iJT-tt. n.— £>&*-y 
h 9-^ £&ffl^-X©£&^T£?*3LTl^S«"&tt. 

mfc£5MB/sJ^T©3SHl*I-e{£ffl 

•5. IC. ^-l-v-UXhU-^yXrA^. *>yh"7 

■9— t*X»cSc>TH-S)flfi©a.— tfClUBSS-S-AS Z. t 
t>*0*S. ftoT. ^-fViJ^Hz-^yXrAtt 



[0 0 12] MtrftilCD*iS0ijT-tt, 7*7-1"7'J ICfeJBL 

5. HfttCfcO, Zf'J'C? U X h I/— yyXfAll ft 

-i'WfOffi^h5 7-f -y ^fc^ofe b-frT 
<4i£©Mtt. ffi©^7h7-7M0fxTft^5i 
tt*. f&©*i5S#Ji:bT. 7'7-<'7UXH/-yyXf 
A«, |»*St*>i"JX hU-^S^T-AfcCaW"* 

* si?*— * * mm \z l x v »s ttsi w-r s . 
tA^uxj- u— vvx^Atcfegrr^ 

A>yijX h l/-yyXfAS7'7'f7UX h !x— vv* 
XfACD57--f/-yn tr-&#!$f **tt*iirilBK: 

yX X A tt i £ o T I^SsMBSIt*— ^ 

i^lLT, — 5£©IB#«iB*.S£, «k OKSflfft-fe* 

[0 0 13] ^.IZ^m&lX'it, XM/-i?gHTO$ 
•y ^-i'ffflnx hfcg/McTSTj&fctlirr^. * 
ST. x-^tejMfCffiffl-r^^l ©*-y b*7 

#75grm, z.<om\<n^jW—^ 
x;u— 7"7h. <&ffl?5. x^— gs. so:i7-© 

tfo lgl©*>y h7-^«^SnfcflJMff^ifcb 
[0 0 14] 3HflSW*SBT?tt, h^-^CH 

*e.n&w#si*«iiiifc*n&v»!KiBT?t>, fxhiwc- 

•y h"7-^OiW*S)*fr©E«*«WBT#fce». Wl^SS 1 
-y h "7- f (DMmtt&m l:«»t<5* fc*^By1{c^ 

•y h^-^Kifc^TtttfctfJScfaT. X. Il©^7h7 
— i/tt/tyij 7^^7 h7-7t?f 2©*7 h9-7tt 
7"7'f^-h^7h7-?T-*5. 3.— !f*l*yh7- 
J'tfMtt&ffiffi-r**^. MS 1 ©*•> h ■7-^*^2© 
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sg i ©* -y h -7- ? T'<D&i$i$tm<D¥£±zmmizWi 2 © 
[0015] mmmtLr. i7-sxBi7-?s 

^©x^-i&^X^LT. X^-^StHCTS. 

*KfMtw:> 0>j;t«, 3.— tf©#u-> 
x5 _^^K#fi^Tt-i£M-r^i. tux hi/ 

C0016] s-&*ffi©fg£T% £W**y by- 9* 

5. 

[0017] mvmm&mt. *v bv-zzmiR-rz 
ioj^±ott«^, x— tffr ejggs nfc 1-3 jw±©# 

©#-h£3iiRT£*te> ttm<D—fflT'fc2> a 1 
0i|T'«. ffi£fc*-y h^-^cDl^^JiO^^^X^-r 

•s&k, *v by-^^-^^mi-x, i-d£X±<d* 
v by-2<DVim%mmi<v. ^iDm^z^-Dx^mm 
Tjuzm^-r^m^y b u tt^^^-i'Ci 
irr* io«±<D^ffl^-hss^-rsfci*t', RKiB 

a.— tfrt^Jg^tlfc^U y-Sj$oTU5. * 

c*fj££-e-. lo^iro/tx^u-^tc^LT, lojy. 

±©#»J i/-£2*fS$-tt.5 
[0 0 18] JE&3*M0JT-te. XH/-^i*<I« 
3*15. *ZM/-ySfll 13K±07-fX^K7 

•y-tf-£#T-3. tt»C*vh l 7-i'0**B. a— If* 

tttli, 0fl*tf. Rfttt. flWcte. «'MI> 

ffliW. Xtf !«»**# *.6>ft*. 

^•n-fe-y-y-tt. *M$c*-y by-W l oujU©^^ 

t, mm%.*v by-pizz^s-Th 1 e/,±©&ffl#- h 



[0 0 19] lit'. ***Wrtt. 7M/-ygIBS 
&©#&** ££f£. £©#*«* «y h^-^fcfcffSL 
T^*. ■y'D-fe-y-y-tt. *ttffia*tt*K«tO. *»© 

. &rr ffiffl^ffi" *#s*i3. ^ssw-ctt. l-r? 

JSWrioTte. *v by-c\tm^<r>n7,i/)V-y\z 
sf)V-zr<tzn. tfus/— til SOP— 'TVa©*? h 

-f u a-Ac^isn, u j.-a** i -z>&>± 

©^X£OU-:y*l*l©*-y h"7 — i7fCT^-feX-C^S. 
[0 0 2 0] *$BfittSl ijS2©*y h>7 — y-T'«J& 

IK^-rs. *fg0J3©H&&#ft *BJM«©^1 
[0 0 2 1] 

UBHOftJKOMM #«9itt. 7*7-fvU -Xhl/- 
?m& fc U ^- h • X h ^-^««MO«»«tt7*-^ 

-Sffitt, f-YX^- yXrAffiltyho-f^— y^ 
tT-©3 7 — M<h^Sflfi©->X7-AfCffl^-r-5. -5- 
020©T^X^yXfAH M=J:OffiS85ttL 

t!-y7fAti P— tDl'Xity'^^C^V yXf A©5 
7-'f^-ySffilft5. 5 7-f^-ylt Uf-h 
X«"fe* >y U f-fXyyXfAl^atlS. 
[0 0 2 2] U-AJl/f'fXJ'yXrAd ^<T©n — 

*;i/5 i 'f x^eyx^ AftJtc^— ^$:=ihr— -rs. *xh 
^□-A^r-f yXf AOr-^^IfrtS t, a 
-TaJy^-fX^y'Xf Att. ^©ntf-Sr'J^E— 
hyXfAC*-ht^7 h"7 — 5"J >^ ^rjl^Teii 
T5. fi£s>T, ^XhSjf^<hLT«, Jl/^-f X 7 

yXfA#U a-A©S 5— f ^-3?*«»t5i«I4 

fWlttttU*— hP hT— SfB©»i(BIK#V»Ttt, 
U. S. Patent No. 5, 459, 857S.I/5. 544, 347^^#BST-5 i: 

[0 0 2 3] D-73;t'S.Z>*'J ; &- h^-r x^ra©^— ^ 

H" T«, D — fj)Vf^ Xi7 yXfAlt *XhA^O 
Write5*0^7***-r*«l»', U ^E- hx< X i7 -> 
XfAtC^-^Kil^ff 5. M q»BIJ«t- K" Ttt, o 
— ^Jl/T^-fX^ yxf Att. *X h^^©WriteS*© 
^7SS4LTA»e>, 'Jt-hfWXi'yXfAi:?- 
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[0 0 2 4] uni:«LxT "jg^-H" Ttt, ut- 

fcT-S/X^ATOf^aWKai^-HJwWViTtt, U.S.Pa 
tent No.5, 933,653Sr#BBO^to 

[0 0 2 5] HlAtHlBft 1 *M0!lT<D 

ft^yXrAM^^fflt'S^. HlMC^Stl 
£*P<, ^7<TUX h l/-yyXfA 10 0 aRtfir 
*>y'JXM/-yyXrAl 0 0 b£^£n&2 0CE> 
Xbl/-yyXfAH U^-hXM/— >V\*7^77 

1 0 0 aS«t*>y'JXH/-yyXfAl 0 0 bco 

XM/-^yXfA100atl00bH yn^A 

[0 0 2 6] »fls + tt, ^7ijXhl/-yyXrA 
lOOaKUftSntf-^t t*>^UXH/-y 
yXfA 10 0 brtCDl^— ^-f ^O^U :x— AK13 tf— 

>?£frmttl2>Z. MAtf, 79-fvUXh 

v^X^A 10 0 aficD^U jl — A 1 0 3 1 0 
3bK»ttSnfc««tt. t*>yjXhl/-yyXf 
A 1 0 0 bWO#U — A 105a^l05 bt:$7- 
^n^>o y7^vUXM/-yyXfAl 0 0 aWt 
*>^UX h U-yyXfA lOObll 10CD.X>^ 

□ /HW7-fvUX I- Ky/XfA 10 0 a (Dm 
ff(:A7^77^-t:XJtlftt5ai:XM/-y 

vx^A^ipfiffl-r^ct^fes^fcLn^i^ 

[0 0 2 7] UDX.T> *»«l:±otlt ^TU3 
If- t-fc* >yj 97 If — ©««**iiM6 

UXh Iz-yyXrA 10 0 b^7*7-1'vU XbU-y 
yXfA 1 0 0 a©»0*^*U i — A<£>5 9— ffiSr* 
tzLtzQ. »t:7'7'1'TUXM/-yyXTA 10 0a 
#«"fert >^U X h U-yyXrA 10 0 bODgg-P^£># 
U a-A©^7-fiWctCifcfe§. 
[0028] «M30a^l30 b*7)£n^ 1 ^Jy>± 
O^X hyXfA^ ^*JW\'X 131 a-* 5 131b 
£ri!LT'>te< dr^-^^-fvUX h l/-yyXf 



A 1 0 0 a^>^UXM/-yyXrAl OObi: 

»zmmm\z&\,*Tit* ^*ju/tx 1 3 1 

a^l31 btcSCSK 7 y -f A*^*Jl/, ESC0N^F**{£ 
ffl^tl^o *XhyXfAl 30atl30bH, ^-V 
^;U13 1a^l3 1bSILT, ^7<7UXh 
l/-yyXfA 1 0 0 a^t*>yjXh l/-yyXr 
A 1 0 0 bCD#U 3.— A 103a£103b, *105 
a £ 1 0 5 b±H«#^nfcx-^i--?'tl^ : nT^irX 

[0 0 2 9] fl3>V-JH 20a^l20bH ^ 
n-E-WU 1 2 1 a^> 1 2 1 b*IbT> y^-f^U 
XM/-yyXfA 10 0 a^>^J X h 
XfA10 0bl:»«t5, *l(S0!li:±oTH /Ui 
2 1a*12 1blt LAN, #ffl/tX, SCSK 7 

-JH2 0aSlLT, /^XM^-^I/O^tP U 

[0 0 3 0] ft«fl9&*««-Ctt, h?-* 1 4 0 

ate, /^U7^ fiA7t-"7>X 

al^>^-*yht*5. CCTf. " y^U7^(ft 
ftflDt)©)" tl/^fflRtt, BKSiafcA (BSMCteKBE 

^«ft*7h9-^*tl*«. *^ h«7-* l 4 0 
bH\ ^7^^-hT, i|/Ut-T>XT\ ^ir^Fn. 

<5*JS0STte, ^7h9-^140 b«T3jl{iEI^*eS 

a. " y^-r^-h" «t**h7— i:x 

[0 0 3 1] BP-fe, " /^U yf" *y h7-^7ft (til 

\Z, y^^f? U X h l/-y yXrA 10 0a tt^J >^ 
iJXM/-yyXfA10 0bOfflS, 2»^^ 

[0 0 3 2] 0iAl:*^m ttgco^^x^x 
9->?l lOa^HOb^ MOla^lOl 
bi*yh7-? 1 40 a-^1 40 bRf1<Z>*?*D hnjl/^ 

1 0 1 ad*SCSI 

T% *7 l 4 0 a*H 

ft^X^Xr>yi 1 0 a-^l 0 1 brt*. SCSI?* 
hCO^-^^TCP/IP^P h3^»SCK:IBi(l, X* 
0>i8e£fr5. l^i^-HOla^lOlb^ 
7<7'JXh Iz-yyXfA 10 0a t^X^X 
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9->yi 1 0 a*»«rT3. ^^^PXi7X5">^l 1 
Oate, ^7 h 7-i7 1 4 0 a-^ 1 4 0 b 

[0 0 3 3] h 1 0 1 a*** 3/ — # 1 4 0 a 
#-h 1 0 1 btfi*y 140bL 
;H?Xr>^110aSll/T«§«. lo«_hco 
*-hl02a^l02bt), t*>^U^M/-^'> 
XfAl 0 0 b^ft^X^7Xf>^l 1 0 b&mtr 
f§ 0 ft^x^Xf>^l 1 0 b***y hV — Z 1 
40atl40 b^^lSlttSRlfil^TS. 

[0 0 3 4] HlBtt, ^7<vUXhl/-yyXfA 

1 o 0 ai-fe*>yUXH/-yyXfA 10 0 b(DM 

J^f>^110a*110bMIS^. £<D^S60*J 
Kis^Tte, ^7-fTU7M/-yyXrAl 0 0 aft 
<£>*-h lOla^lOlbH *y b? — ^ 14 0a 
^ 1 4 0 b I: 1 OK±^ >?-7 x-X, m?L&7T 
-f AW >^-7i-X 16 0 a-^IP-f — yx. — X 1 

UXhl/-yyXfAl 0 0 bl*l<0#-~b 1 0 2 a^l 
0 2 bte, fft^y h7-^ HOa^HObC 
77^/H>^-7x-X 16 0 b^IP-f — 7x — 
X 1 7 Ob^bt, ttSlt^o 
[0 0 3 5] H2tt, *»W©l*«S«T©/tXfc#U 

|>l/-yyXfA 1 0 0 artOtf U n. — A 1 
03a> 103b, . . . > 10 3nit K7stf)V—7 

2 2 0 a, 2 2 0 b 2 2 0m£>£P^, 1 ~DVA 

/IX^-T^S, *y h<7-^ l 4 0 a<ft£a# 

*y b9-#fc»iirr*&<B#--h 101 a-^ 101b 
\^\^Al(D^- b&Wr*. H2lC*^Ttt, A° 
7>#)V-'f2 2 0 att*y b7~? l 4 0 al:8«t5 
H01 a£WU /U^J1/-7 P 2 2 0 btt*y b 
7-i7 14 0b CgitS*- HOlb Stt5. 
[0 0 3 6] /Uffiffl*Uy-2 10H l^Ua 
-AS i ^±cDAX^;i/-:^c#j££ii\ 
*>yU7M/-yyXrAHfiIt^i:t[:ffifflt5 

T, ^-f^UZMz-yy^fAlOOaWJa- 
A 1 0 3 brt^r-^^t*>^U7 FU-yy^rA 
1 0 0 brtCO^Ua— AtfiaTStSICtt, Sg— fc/t 
X^-^2 2 0 a©#-h 1 0 1 a^IKt^o 
flJS^OJSBT, rt7stf)V—Zf2 2 0 a 

/U^;H7 , 2 2 0 b^I^tlSo 
fcU /U^-7 P 2 2 0 btfMIPFUfcS, AX£Ol/ 
2 2 OmM^n^. 
[0 0 3 7] H2»C45W*t)5— O(0«iL/T, *'Ja 
-A 1 0 3 att/U^-7 p 2 2 0 a (D^tf>ffi/3#ff 2 



[0 0 3 8] @3H *»«Ol*lSWT©ft»fi!lft/1 
XlRr-^l/SBStS. 0 3 K^bfc£n< , AX^ 
W^- ^ 3 0 0lt flfl^tf . El 1 <D# U -3- A 1 0 3 
a^l 0 3 b<Oft]#2RU jl — AtCjtJC-r^sPU i-Af 
^3 1 OS, B2 0/U^l'-7 P 2 2 0 a^2 2 0 bCO 

^3 2 0 a^3 2 0 bl:M#Wo *Ua-A#t3 
10H, X M/-yy7fAtTBtOM"eS«. Zf 
=y<i V'JX hi/- yyXrA 1 0 0 aH /tXlRr- 
7^3 0 0 Kfe^T, #Ua-A103a*l 
0 3 b^CD&^fr^-r^HW^^U^ — A#^-3 1 O 
Sj#^o 

[0 0 3 9] AX2Ml/-:/#^3 2 0 a*3 2 0 bli 

lTBt<Ot)©T**S. 0»Jx.tf. 3 2 0 a^3 2 0 b<£> 
5P< , rt7>#)V-Zf\Zftfo\sX 2 f@«±CDX> b U 

fTT5^X^--7 p S*§3 2 0aH \1kWt$%>n7,y)V 
— ^#-^3 2 0 b cfcOjS^T^-f stU^ SEf^. 7^ 
< VJX h l/-yyXfA 100aH -tz;*j>^'JXb 
Iz-yyXfA 10 0 b ^-^fe^SfT 7 

5^ * u ^ s*rr>Ax y ski— fc:K«-r 

[0 0 4 0] #J;Lk£, H3tC*3V^Ttt, /^X^;i/— y# 
^3 2 0 aH /U^lz-yS^S 2 0 biOSi^^ 
^^Ut^^o y;i/CD^ 2 <£>frK:£X/>T, 

7UXM/-yyXTA 1 0 0 a«#§0O;U^- 
[0 0 4 1] 0 O^U^-^X 

sn, ffiown©y';H/'t)ftfflTsa:^fcft, ax^ 

;P-y#^3 2 0 bOMJSffla^ttNULL^f2A$tlTV^ 

[0 0 4 2] H4H *5SK<Ol*Jfi0»JT(O^M&/X 

\Z, /U^lz-yf-^MOOtt, /txffiffl^u^- 
2 10 S^ffiLfcAXtCO^TCTM >7;*;*-:>3>S 
5KU AX^;i/-:/£7p-b<h£#/Stttf£o AX^JP 
-7*r-7';i/4 0 0H l^(DXhl/-yyXrArtT 

&^x^;i/-y^bT@Wfcf»jo^Tenfc^x^;i/ 

^^#-^4 i o^ttS, M»?J4 2 0^, /^X^/Jl/— ^ 
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et±osjt?jS: i t>coyix^;i/— :/cs»Ts***ffl* 

[0 0 4 3] *5B9Jfc<tn«, 
W^tTRCjZti^o h#^4 30a, 430b, & 

#4 3 0 cii &K7,{f)v—7\z&vyz>#— vm^\zn 

jfc-r£#*t*«Err*. S-tS-M3:X >l/-^y7fA 
1 0 OtTlt^M^oTt^o /U^JKyf- 
y;U4 0 0<£>#-h#-^4 3 0(DX> h UflRckO^ft 

#K h#^4 3 0 c KteNULL#^£nT^5. 
[0 0 4 4] Xf-^X4 4 0H SK/U^H^W 

XbV-yyXrM 0 0 attttStf- 

"To (Wtt4 2 0# "X7-$5%*i (Error 

Rate less than 555) " T\ W^JB^tE" tfcJi<0 

;U* r ;i/-^2 2 0 aSffifflLT, 0iJ*_«l# 

XfA10 0a(^«SlT, X5-**15XETF 

[0 0 4 5] 05H *^§|<DlHSffi^JT^f^*W^ 

XfA10 0aW^Xf7^Ifft^)o X-r^^ 
5 0 0fCT, ^7<VJXM/-^yXfA100a 
te, /UI«t-^3 0 0K7#-fcXLT, -fe^>^ 
UX h Iz-yi/XrA 10 0 b^<D^— ^tR^k<Dik\Z&s. 

yXrAlOOaH KiHf^^-^ S«ttS# U 
a-A«Sfllt)T^5a, 0 Ocofr 

3 2 0 a£i!tR-r£o Xf-^5 2 0i:t, /^X^MU- 
^2 2 0 aMI^j»SU^i^l ^7<7'JXh 
k-yyXrA 1 0 0 a«*^iOILT', ^X^JU 
-y#-^3 2 0 b£HtR-r3. 

[0 0 4 6] Xf7^5 2 0TH /1X Vfr—Zfifi't'* 
TOWtttJII&r^ftH^S. AXMr-^3 0 0 



«€ite> 50,31^X^^^5 4 0^31^0 Xr77'5 4 0 
KfcHT, ^7iJXM/-^>XfM0 0alia 
U a-A©t^ >y U X h l/-yyXfA 1 0 0b 

[0 0 4 7] Xf7^5 2 0l:t, «#9Sr«lfc"r/^^y 
XT-iy^5 6 OKT, SR/^ 
Xi/;i/— ^©ifeT<07p- h^ffl + ^S^Sr^x^y^T 
-5c 7*7^ 7 U X h i/-y yXfA 1 0 0 a ^it*- 

«fflttas. ffiffl*T^v^-hA^#?£i-n«, x^r 

7 7*5 3 0 CT^7-1"7UXH/-yyXfA 10 0a 
^L^-^fiSSfrS. fr\Z. Xf7^5 5 0l:t, 5 s 

tf, Xt7^5 0 0I:IoT, y^-fvux hl/-yy 
X^A 10 0 aaffi^/U^JK^i^^o 
[0 0 4 8] ©J*5 

?%(D~X:$>Z>» BMIMtttt, 7 P 7<-?UXM/-yyX 
^A 10 0 aAU00/U^-^ffifflffi*5^1 

9:00pm^6> 6:00am<Z)P H 1(D^ M £R*raft»JIEa*&-pfc* 

^B#^8:00amfc^ Zfv-f T U X h U-yyXr 
A 1 0 0 aBSR/U^-7'£«Efflt*&^, t^-f 
?ijXM/-yyXrA 10 0 a te^-f A^ U <y £ $1*1 

[0 0 4 9] y7<T'JX hl/-yyXfA lOOali 
7-fvUXM/-yyXfA10 0aH ftMMtttftt 

4 4 0$ "tt/B^tB" izWLfe-r*. XW7H» 
tt, y7^vUXhl/-yyXfA10 0aj()UaoA 
x^;u-^^o^x«ffltti*ss^:x;i/-yiy b$ffll$g 
-r^o f^jAtf, 44 5mb/s m oxju-y^y MM»a«, 

A<5. 3MB/s1?*ntf , ^7-fTiJX hl/-yyXfA 1 

o o a«*^x^;u— ^co/^x*^Ji^s*ttai*3a 

[0 0 5 0] ^VUXMz-yyX 
it. V 7 h9i7«**4*- h©X^-yy 
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T5„ ^n-tyU-3B«-J6*M«f. «*tfltl>M 

K & -5 # - h * 31 o T £ ft -5 x - ^ ft £ ^ - T 
-5. -eco'^. #^a-fe-v1tT-Si]3t$nfex-^ft*^D^ 

£tt. £&©£ii-#^#-h#mJlT3Ax^ju-7 

100 ate, bfflmmfzZntUS. 7.7— 

£tl&tttltt\ Xf-^X4 4 0 £ *'-B#W^ffiT^" 
[0 0 5 1] /7-f7UXM/->'yXfA10 0a« 

mm^m" s*bas»Tv»*iwtt. vuxhu- 

«, ^5-f7'JXM'-;->XfA10 0a#lOC!)A 

*n«, ^-fviJXMz-yyXfAlOOaW 

[0 0 5 2] *ttW5fc*Tf. -/^-fVUXhU-vv-X 
fA10 0aW(D7'nt-viJ-. A-H"7XT, &.tf/X 

- ' xta looait tiLmmumm&zntuixT—? 
X4 4 0& "mmoim" \z. mmmmffi&ffigiZntsLn 
ntfxf-^x44o & *'— mm&m^fW i:K^t 

[0 0 5 3] 7 , 7-fv | JXM/-yyXfA10 0att 

Xt-^X4 405 "ffifflW CSWT*. fc^X 
y , ;i/-7*CDXf-i'X4 4 0 rt* "— Bf tfJ&ffl^tE" 5* 
Lttinn5Mt>. 77-f7'JXM/-yyXfA 1 0 
0 aBig/U^-7 , SfX h&fflTS&IC&SiJWFa'] 
RfT-®JRT&. 7*7^ "7 U X h V-yyXfA 1 0 0 a 

[0 0 5 4] l7-¥MJS)tt. 7'7l'? l JXhU-yy 
XtAI 0 0 a*llOffl/Uy';i'-7'CO^Tffiffltli* 

***x5-*s*jir*4. "ior 0x7- 

^fMlftrt*. fc^AX^U-^fcttLTK^SnTiJO. 
7< 7iJX h U— 5>->Xy-A lOOaB, 



•7U X h U-^yXrA 10 0a flfflT'nt yt. A— 
H7X7, RtF/Xtt. y7h7l7iW&#-h® 

1 #ffl \z & -s #- h sffl o TteM$ na teitm t X 5 - 

[0 0 5 5] 7*7-f'7 | JXM'-yyX7A10 0aS 

n«, xr-^x44 0$ "®.m*im" icas-r-s. & 

5/U^l'-7'OXf-^X4 4 0AS "— P##H£ffi^ 
m" SSLttttTHSMfc, 7*7-f?UXhU-yyX 
fAlOO att^aSAX^;U-^2rxX h^fflf-S^lr 
«BIIWK:[«mi*;6Sa*?"r*. 7"7-f?UXhU-yy 
XfAlOOattfXMMOTi. te©Ax^;i/- 
7*^«fflf5„ 

[0 0 5 6] ftffiffltttt. 7*7'f'7UXH/-^yXf 
A 1 0 0 a CftT, 3gyXfA«)MiJ;t)ffi|t 

T. AX^-7"©SS?C*JEgS:iST. 

■7-7 1 4 0 84Bat*^f h"7 — ^x^te^Sxi 

>v-;u 120a \z&mzti, *fia >v-ju 1 2 0 

aSrilLT. 7*7^ V'JX h 1/— 7->XfA 10 0a© 
■**•— tfx^tB©;!/— Sc, x^— 

TUX hi/— -7yXfA 1 0 0 a CMbTiSl, 
h-7-7 1 4 0 a*»«ffliiIIBiKIBKH**T?. y^-fv 
UXhly— yyXfAl 0 0 ai«Xf-^X4 4 0$ 

[0 0 5 7] te©fl.«lH»©e«£LTte. a-tf*SO 
tfA^&S. fct^-ti. XL— tfttjg^^>^>xtp© 
*7 1 4 0a$-^i:tffl?ffii:t5 

:t*t*5. 3*fr«fKx. 3.— tmy^-f 

7UXM/-^yXrA10 0a±-J:, fl3>y-jl/ 

UOaOTLT, S^yh7-7l40a©Xf 
— $7 44 05: Kit"*. >X** 

71*. a-1fHXT-^X4 4 0£Rtf "&JBnTffi" Ic 

[0 0 5 8] S6S.Z>'ia7 tt. *5Vm<D 1 *J&MT-©ft 
SW&x.-f'f>^-7i-Xroy-f7y'7AT^5. 
XL— tf y h 9-^ h 7 yj-y 9 \zUmt:Wt%\Z 
«. 7*7-1"7 l JX h |/-yyXrA 10 0a CMtT, 

^ns'gsia® 6 0 0 is, ssxi >y— jut?©-?-©&© 

ZL— tf-T >^-7i-Xtfc5. XL— tf^fl7-f 3> 
$7U77t5i:, fla >V — AX'. ^liHiE 6 0 0 
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-A^H^^^^T^o H6O0yTtt, " Juno" 
nZV—rtlfi" /dev/rdsk/cltldO" , " /dev/rdsk/ct 12 
dO" £foZnZ>2-D<D'#V =l — ASftSo 

[0 0 5 9] i6T11 r/HXW^X6 2 0^ 
TAMX" /dev/rdsk/ct 12d0" Oft«S^bt^5. 

6 3 0, xA + < Xtif$86 4 0, Ut-hai;-ii6 5 

14, y7l"7'JMt^>yU*Ua-A5(t^7-?:i 
[0 0 6 0] U^-hX H/^y^fAMii, ^7 
2 <h^K^TC0ny— ->a >£^1~n^r— ~>a > 6 5 3 
ij^mt, XhL/-yyXrAM6 3 0T^n 

[0 0 6 1] n-AJ^h^yyXf 

a. aK«iTB "n/a" #ssti*. u^-hxhix 

#)V—-f "T3 up to 5MB/s" tt "Internet" ckDSS^:/ 
0 0 a^t^>yjXM/-yyXfM 0 0 btc^- 

^(Eiii-rst^^tt, mmz **T3 up to smb/s" saw 

[0 0 6 2] — y*3&*» /U^-y6 5 4*>5 1^© 
^Hffi3 6 5 5 ^A*-rS«P^«k0, /Ui/JH^SS 

y7^fVUX hU-yyXfAl 0 0 aft tfUa.— 

[0 0 6 3] ***©*ifiw»CctoTtt, i«snfc/t 



tf, a-W@6±T "TP up to 5MB/s" Mffi&miR't 

st* b 7 T^snsii 700 a^stiSo #ixJ4\ h 

m 7 0 0<£ttl£@®£<£fflL'T, ^-^HMfitt 

So 

[0064] 3-—*fnfima#*>7 so&pv 
iffl^n^o M*#^>7 6 o**y 

-^M^§ 0 iftt, [3 6 O^SiliB 6 0 0 

s;->XrA 1 0 0 ai:it>Tl«Sft, n.-lftri;oT 

2nSo »:fia>V-;H 2 0alt tffcj:^ 
T/U^-^I6 5 4l:AASn&/U^H^« 

#-h#^^*»-r«. #J*-«> /UW-y "T3 up 
to 5MB/s" B#-h0atfll:«»3tl5. 

[0065] fix, ti3>y-;n 2 0 a a, 

h l/-yyXxA 10 0a KHtfTT*. 
8ffl^ft*5RBt So ^Oti7ya>H cn^Tlft 

cni«flft«*fcf *fc»T*6 u t CCftt* 

[0 0 6 6] H8tt*«W^imfi^J"C, — ^filJ^TO 
S„ H8IC««Sft**«»w*5^TJ4, ft*X;i/-^y 
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ftffl$KTT«ffl$ni>. *mm\z* mat**? bv— 

[0 0 6 7] H8^SStlS7P— J 1 ^— htt* T^-f 
7'JXM/-yy7rAl 0 0 a**SE0G&:*? h7 — ^ 

£>, h7-^£«ffi-rs<k5fc, fl3>y 

8 0 0i:T, 06, 07 (DO.— tJW — 7x — X£rffi 

Stf, 06, H7©a-^>^-7i-^ 
*fcU b7-^lCfg2<Z)7 p ^ tUH 

[0 0 6 8] ±9&<D*7'y?\ZX* 3.— if**ftfJ*9«gP»CD 

h l/-yyXrA 10 0b tC^bT^-^KSI^Ba^T 
XH/-^>XrA10 0aH *MS^$nfcg7^X 

tH#fc^£* ^^UXUz-^fAlOOaB 

7^8 0 0l:t, ^W^t'yht^ffefflS^o 
[0 0 6 9] H9I1 *»W©l*JfiffilT«IHIia«05R 
«B&*y h7-^^ffiffi"TS^(7)^K)^*7 ft D-trX^* 
t7a-ft-ht»5o 09l;:^2tt&*S0yTte, 

1) H7-i7^ffiPfl»^^^fi£ffl$ 

te, ffi(OE-Mail^WebT^-feX^<Dit-tfX^^8^ 

mifw^uy^**^ 1 ?- 
^/7^> y h7-dMcB!jrrs. 

[0 0 7 0] 0iJxH ^7<7'JXM/-yyXfAl 
0 0 a^/tyj h7-^^ffi^:I^^ 
fc, n—tfte 4t 9:O0pm7^£6:O0amCDP B E }<£>^' , ©RflBIHffi 

>y-jH2 0atttfflbT, ^-fTUXhlz-yy 



XfM 0 0 a**, ffifWa«<D»t*flBtt*^ h7-^ 
S«6ffl-r*jfe<0ft!l»«»SS*"r. X 5^:7*9 0 OfCT, 
zl— tfttH6, 0 7<D:x— *f4>9 — 7x — XSffl^ 
T, 9:00pm*e>6: 
00am) <7)*ttffltH*S«t5KLT, **yh7-*C* 
lO^-ftUf-fSW. SfC Xf7^9 1 0\Z 
T, W@6, 0 7 ©a— if < >^7x-X^ffi^ 

Iz-^fAlOOalt 0 5O7O — MdtE 
ot, ir^i >^U X h l/-yyXr A 10 0b Cf-^ 

[0 0 7 1] dCTOtE&t, H5*6b*4±5lC, 
y7^Y 1 J7M/-yyXfA10 0a}l StPfl<£>9:00 

^Y'JXhl/-'»XfA10 0aH ft&ORpMffif 

[0072] aioit *^oi^jseaT<7)ft&(of^« 
w^^x^A«^^*brc0T'*So aiotssns 

*M«T»4, ^7UXM/-yyXfA100a 
SS0fl«, b7-^£^8B#P*l^-XT£fM> 

[0 0 7 3] (1) $IM7h7-^#Ub77^7^ 

h7 — ^^E—^rt*, SftflB&^y — i^T?©iSb 

"7U 7 h l/-v?yXrA 10 0a i:I*Dt§. T 
£<h, ^7<T'JXM/-yyXrA10 0aH *y 

[0 0 7 4] (2) ^7-f7UXM/-yyXTA^^S 
fctt, h7-i^tt<5flia:*y h7-£<fcD{£ 

0, t^>^UXM/"-yyXrAl 0 0b[:£I1-< 
^TUXUz-^rAlOOat 

tsa^n^o $ffi^7h7-^^sii(DSST^^ 

£, y7-f7UXM/-yyXfAH £E>^Jg£r«fctH 
UT, SS$nfcT-^^>^UXhl/-yyXT 

7-^M0f^5o ^CSI^-^^fcSOffl^T^^ 
<7UX h U — i;y^fA©f- ^^rir^/ >^U X hi/ 
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[0 0 7 5] (3)X^-^RB^H^@X.fc^^o y^-f 
7'J7 h Iz-yyXrA 10 0 a te^y 
fcx-*ifei£T<ax^-|fr£&;L, X^-BgSrffai-r 
S. ^7<^'JXM/-yyXfA 1 0 0 aH jfcffifc 

*^t#Hi*«. ^^f^UXhU-yyXfMOO 
ate, »*7h7-^^W1T^, fXb@ 

^7<7UX h U— yi/XfA 1 0 0 ate, <5rXh@fft 

U-vvXt-A 1 0 0 ate, ^ffi&^y h^-^TCDX 

©«S»7t^ #ftflr T te, SScto**;/ b<7-^£b 
TiS^^K^iS^x^-^^-r^TCP/Ipya 

[0 0 7 6] (4) X^-~#S8£bfc*§'&o ^7^fVUX 
M/-v?yXfA«*7 b7-££ffibfcfcitT£>X^ 

te, h7-?Tl7-#«4l/&5. ftOfc: 

7UXM/-yy^rA^ £fte£«fc:*y h?— £ 

[0 0 7 7] 01 0TH 2^<2X b l/-yyXfA, 
HP*>, ^5<T ij ^ h l/-?yXf A 1 0 0 a tt* > 
^•JXhl/-yy7fA10 0b^ Ut-hXM/- 
y/t7i777^BO 1 yXfA^ifilttS. *yh7- 
^7^ 1 0 0 011 *yh7-?140at*7h!7 
-/7 14 0 bRtffl3>V-JH 2 0 af:8«Sn 

h^ — ^^X^ 1 0 0 Oil *7h7-?14 
0a^:*7h7-^14 0b^)ffiMilSn n /Ul 
0 2 0H *y h?-?*-^ 1 0 0 0 S*y 
14 0a b? — £ 1 4 0 bJC««-rS. 1 0 

1011 *7F7-^ : E^ 1 0 0 0$fl3>V^ 

120a fcsaarr*. /u 1 o 2 o t/^x ioioh 

WAH -T >^-**y KDcfc^&Ht:^^ b-7 — £<0— 
«Tt>A^. b^-^X^ 1 0 0 Oifl^y b7~ 
^140atiSh777^77^ffiLfc^, S13> 
y-JH 2 0 atlfltS. 

[0 0 7 8] 01 1 te, #5gBJ3£){ffltf> 1 *JK«T©ft« 



y7^- 7y Ft, ^7h9-^«1100 

te, gj6<7Dy^x^;u--/6 5 44 i tcs^^nfc^^ bu 

— ^*^JS"TS. "T3 up to 5MB/s" , "In 

ternet" ftt^ffl^6ft5. *y b7-^« 110 0© 
gWoi"3H fln>y-;H 2 0 at^7 b*7 — ^ 

*y b^-^x^ 1 0 0 0#*-y h^-^ftW+fclfcU 

[0 0 7 9] *^BJ(D^^*JE0iJ^»lCbT, 

5. "«Affif" «SH *yh7-^ ; E-*1 0 0 0a< 

b7-^rtT®Jl^#£^ffibfc£££^ 
To "j&MW ^SlCte, *yh7-Jt^l00 0 

M 3E*K«»" ISH *7h7-^ 1 0 0 0*t 
bv — 2 1 4 0 a^(E#{£ffl*£ATcDh^^-< y& 
»:«»LftuiSit. saeii l 2 011 
9— /7^rx^ 100 o^fia>y-;n 2 0 a\Z*y 

[0 0 8 0] B12H #fgBJ<Dl^M#JT<D*y b<7 

-ft.-htSSc HI 2 t^-r*JfiOT^*3^T, 
b^-^X^ 1 0 0 Ote, 7f77'1 2 0 04^12 
3 0 S^ff fl3>V-;i/ 1 2 0 ate, Xf7^1 
2 4 0*>S 1 2 6 O^^fff^o Xf7^1 2 0 01: 
T, ^b^t-^lOOOH MM^it. ft^m 
i*fl)tt*©«ft«:Eat5 B Xt77^1 2 0 0ICT, 

ft»*<k#*ai*nfc»^, flfiwy^i 2 1 o\z 

1 2 2 0ICT, *y b*7 — £7^EX^ 1 0 0 0BH1 IT? 
»«L&7*- , 7y hTO/^t-S?Oftil 1 1 0 
\Z "jflftflT #**iz-^*«3:3>V--- 
)V1 2 0 afcSUrT*. Xf77'l 2 1 OKT, 

1 2 3 0 ICT, *y h7- ^^x^ 1 0 0 0 tel^ 117? 
KWbfc:?*— hWyt-y©S§tl 1 1 0 
IZ "JE*" **yiz-S?£'BF3:3>V--;i' 
12 0 a \zmmTZ> 0 

[0 0 8 1] fltXf77 J l 2 4 0 ICT, *v bV~>7 

tz? 1 0 0 ofrt>m*>ntz*v±— vssffiix, w 

13>V-;H 2 0 attS^ffil 1 1 OSfxyJL 

t, ««« "aftw ^ "jEHzizmm" tt<Dfr&nmv 

£0 S^fflJl 110^ "iBAffi" S^bTfeftH X<x- 
7^1 2 5 0 tCT, fU>7-JI/ 1 2 0 ate, AX^ 

^t-— ^;U4 0 oghsr*^ b^-^cox^-^x 
4 4 OK "-iSWffiffl^ffi" £iry h-T^o S^flc, X 
f77 p 1 2 4 0KT, ^^«S1 110# 4 *IE^" $:^b 

T43ntf, xt77°i2 6oi:t, sid>v-;h2 
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"-mw&m^m" *> "^ffl^ffi" t&oT^&^-y h- 

[0 0 8 2] ftoT. ^yh^-?^-? lOOO^fi 

1 0 0 aK<fcoTSS?£n-5£<!:te«^. 
[0 0 8 3] SI 3lt #fgBJ!£> 1 *ffiCajT*#^WT- 

St7D-?V-hTife5. 0 1 3 OT*iS^J-ett> WW) 

ZL-^^mti^-y hU-C\Z^VT, 17-1 

iJXh U-^yXfAft'7 , 7'fV U X h l/-yyXfA 

[0 0 8 4] X^y 7*1 3 0 0 CT, *-y h?— i?^ — 
* 1 0 0 0 &2ctf &^-y h "7— ? 1 4 0 a SrESITS J; 
11 6, 07T^^tlfc3.— tf-f 

pitt^fr^^sns. — k, tsjesns-t, *7f7 

-^^.-^ i o 0 0140 1 2Ti£^&n/t5Q ! S : S:*tTt" 
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Path Selection Methods for Storage Based Remote Copy 

BACKGROUND OF THE INVENTION 
! 0 The present invention relates generally to remotable data storage systems, 

and in particular to techniques for managing data flow over a plurality of connections 
between primary and remote storage devices. 

The information technology revolution brings with it an ever increasing 
need for more storage capacity for business enterprises. It is expected that the average 
15 Fortune 1000 company's storage requirement will more than double in the coming years. 
In addition, growlh has brought shortages of skilled persons in the information 
technology field. These challenges confront many companies feeing the need to expand 
and improve their information technology assets. Increasingly, companies are turning to 
storage based remote copy as a method of coping with the need to prevent data loss from 
20 disaster. Remote copy creates and manages mirror images of storage volumes between a 
local, or primary storage system, and a remotable, or secondary storage system. The 
primary and secondary storage systems may be located at a far distance from one another. 
The two disk storage systems are connected by a network, through which updates on a 
local disk system are copied to the remote disk system. Nowadays, there are many types 
25 of networks that can connect the two storage systems performing remote copying. For 

example, one type of network can be a fast, reliable, secure and relatively more expensive 
network, such as, for example, a T3 private network. Another type of network is 
relatively more slow, insecure, and cheap, such as the Internet, for example. 

Business critical applications, like on line transaction processing (OLTP) 
30 for banking, finance, flight reservation systems, and so forth; requires remote copy 

capabilities with low response times, high security, and high reliability. Other types of 
applications, like WEB mirroring, data warehousing, data center consolidation, bulk date 
transfer, and the like, do not have such requirements, because these applications generally 
do not need to copy data in real time. 
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While certain advantages to present remote copy technologies are 
perceived, opportunities for further improvement exist For example, according to 
conventional remote copy technology, the network carrier companies charge customers 
based upon a required throughput, and sometimes offer pay per services for private 
5 networks. For example, a network carrier company may charge customers according to 
network bandwidth used per month. However, some remote copy users would like to 
reduce the costs associated with data connections and will be willing to accept operational 
limitations to do so. For example, users can lower expenses by using different networks 
for remote copy depending on application characteristics. A user could employ the 
10 Internet for web mirroring applications, but use a T3 network for OLTP for banking, for 
example. Users who would like to use the storage for backup purposes do not need a full- 
time data connection. However, conventional technology does not provide the capability 
to manage access to the data transmission services of a network carrier based upon the 
charges for the access. Further, issues such as security are important concerns to both the 
1 5 user and the network carrier. For the user, this means that valuable information assets can 
be protected by restricting access to the data being sent to remote storage. For the 
network carrier, this means that data integrity is preserved for each of its customers, and 
that no user receives access that is not authorized by the network carrier. 

What is needed are improved techniques for managing data flow over a 
20 plurality of connections between primary and remote storage devices. 

SUMMARY OF THE INVENTION 
The present invention provides techniques for managing data flow over a 
plurality of connections between primary and remote storage devices. In a representative 

25 example embodiment, when the primary storage system copies data to the secondary 
storage system, it chooses one of a plurality of networks connecting it to the secondary 
storage system, depending upon a users 1 policy. Since networks have different 
characteristics, in terms of, for example, performance, security, reliability, and costs, the 
user can specify which network(s) are used under various circumstances, i.e., daytime 

30 operation, nighttime operation, normal operation, emergency, and so forth. The storage 
systems comprise a mapping of volumes and ports. When performing copy operations, 
the rirLinary storage system finds a volume storing the data, and available ports by 
accessing the mapping. The mappings are based upon policies that are input by a user. 



(24) 



&m 2003-32290 



3 

In a representative specific embodiment, the primary storage system can 
be configured to limit data transfers using a particular network to within a set maximum 
throughput. For example, if a user configures a 5MB /s of the maximum throughput for a 
network, the storage system uses the network only up to the threshold. When the 5MB/s 
5 threshold is reached, the primary storage system chooses ports connecting to other 

networks. This mechanism provides substantially improved performance when networks 
susceptible to overload are used for storage operations. In other specific embodiments, if 
network access is purchased on a pay per use basis, the user can limit expenses for using 
the pay per use network according to a budget, by limiting the use of the pay per use 
10 network to a particular throughput, say 5MB/s, in order to avoid incurring additional 
charges. In still further specific embodiments, the primary storage system may be 
configured to select ports connecting to inexpensive networks, except, for example, 
during daytime, when public networks experience high traffic volume. Further, the 
primary storage system that transfers remote copy data through a specific network may 
15 affect the performance of other network service, sometimes causing adverse conditions to 
corporate operations relying on these networks. Accordingly, the primary storage system 
can be configured to select from other, more expensive, Le. private networks, for 
example, during the day to avoid these types of consequences. 

In another representative specific embodiment, when a primary, i.e., 
20 inexpensive, network experiences a high traffic volume, an external network monitor that 
monitors traffic volume over the networks notifies the primary storage system. Then the 
primary storage system switches to other networks until the monitor informs the primary 
storage system that the primary network has returned to a low traffic volume. Another 
specific embodiment determines when the primary storage system has too much data 
25 pending transfer to the remote storage system. Generally, an inexpensive primary 
network is slower than an expensive secondary network. Accordingly, data to be 
transferred to the secondary storage system is accumulated in the primary storage system 
if traffic throughput of the primary network is insufficient to keep up with the data 
transfer demand of the primary storage system. If left unchecked, the secondary storage 
30 system will eventually be unable to maintain a mirror image copy of the primary storage 
system. To avoid this condition, the- primary storage system monitors the quantity of data 
pending transfer that accumulates, and switches to a secondary, i.e., more expensive, 
network when the accumulated data exceeds a threshold. 
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[n a further representative specific embodiment, a method for minimizing 
cost of network access by a storage apparatus is provided. The method comprises 
specifying a first network to be used for transferring data. Specifying a constraint for the 
firs network is also part of the method. In various specific embodiments, the constraint 
comprises at least one of a throughput, a busy rate, an error rate, and a presence of an 
error, for example. However, other types of constraints are also used in various specific 
embodiments. The method also includes specifying a second network to be used for 
transferring data. Transferring data using the first network when conditions in the first 
network are in accordance with the constraint, otherwise transferring data using the 
) second network is also included in the method. In a specific embodiment, the method 
further comprises transferring a portion of the data using the first network even when 
conditions in the first network are not in accordance with the constraint as a test, 
monitoring conditions in the First network during the test; and renaming to transferring 
data using the first network when the test reveals that conditions in the first network are 
1 5 again in accordance with the constraint. In specific embodiments, the first network may 
be relatively less expensive to use than the second network, and/or the first network is. a 
public network and the second network is a private network. When the user specifies the 
networks and constraints, the use can make the first network a higher priority network 
than the second network, or configure the apparatus such that detecting an abnormal 
condition in the first network and thereupon transferring data using the second network, 
for example. 

Another strategy monitors an error count, such as a percentage error rate. 

The primary storage system monitors how many errors occur during data transfer through 

the network, and calculate an error rate. When the error rate becomes too great which 
25 can be determined by exceeding a threshold, for example, the primary storage system 

switches to an expensive network. The threshold error rate can be determined from a 

customer's policy, for example While using the expensive network, the primary storage 
' system will also attempt to use the inexpensive network in order to continue to monitor 

the status of the inexpensive network. The primary storage system will discontinue using 
30 the expensive network if the error rate for the inexpensive network falls below the 

threshold. When TCP/IP protocol is used as the inexpensive network, a high occurrence 

of errors often indicates a high traffic volume in the network. 
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A still farther strategy switches to expensive networks as an alternate data 
path to the inexpensive networks when an emergency occurs. According to this strategy, 
the primary storage system transfers data using the inexpensive network. But, if this fails, 
the primary storage system switches to the more expensive network. 
5 In another representative embodiment, a method for selecting a network 

is provided. The method comprises monitoring one or more conditions in a plurality of 
networks. Comparing the one or more conditions in the plurality of networks to one or 
more user provided policies; and selecting one or more ports connecting to the plurality of 
networks are part of the method In a specific embodiment, the monitoring one or more 
10 of conditions in the plurality of networks comprises using a network monitor to detect a 
condition within at least one of the pluratity of networks, and thereupon set a value in a 
) status indication, and the selecting of one or more of ports connecting to the plurality of 

networks comprises determining based upon a states indication whether to select a port 
from the one or more of ports connecting the plurality of networks. Each of the plurality 
15 of networks has one or more of user provided policies associated with it In one specific 
embodiment, the method also comprises associating the plurality of networks with a 
plurality of path groups and then associating the one or more policies based upon the one 

or more path groups. 

In a still further representative specific embodiment, a storage apparatus is 
20 provided. The storage apparatus comprises one or more disk drives; a memory that is 
operable to contain path selection information; a plurality of ports that provide switch- 
able connection to a plurality of networks; and a processor. Each of the plurality of 
networks has one or more user provided policies associated with it. Representative 
policies include, for example, a threshold, a maximum, a minimum, an average, a mean, a 
25 limit, a constraiht, a priority, and a target The processor, based upon monitoring of one 
J ~ or m ore conditions m the pliarah^ of M 

the plurality of networks, based upon a comparison of the conditions in the plurality of 
networks to the plurality of user provided policies. Representative conditions include, for 
example, a throughput, a busy rate, an error rate, and a presence of an error. In specific 
30 embodiments, the storage apparatus farther comprises a plurality of status indications, 
each of which is associated with one of the networks. The processor determines based 
upon the status indication whether to select a port from the one or more ports connecting 
to the plurality of networks. Representative statuses include, for example, available, 



(27) 



&ffl 2003-32290 



6 



temporarily unavailable and unavailable. In a specific embodiment, a network monitor > 
also provided, which is operable to detect a condition within one or more networks, and 
thereupon to setavalue in the status indication. Further, in some specific embodiments, 
the networks are grouped into a plurality of path groups, so that policies may be 
5 associated with the networks in a particular path group. Further, the disk drives may be 
divided into volumes, and me each of the volumes is permitted to aecess networks of one 

or mote of the path groups. 

Numerous benefits are achieved by way of the present invention over 
conventional techniques. Specific embodiments according to the present invention 
l0 provide techniques for managing data flow over a plurality of connections between 

primary and remote storage devices. If a customer purchases network access on a pay per 
use basis, these techniques keep expenses lower, since expensive networks are used 
during exceptional conditions. While the present invention has been described with 
reference to specific embodiments having a first and a second network, this is intended to 
1 5 be merely Ulustrative and not limiting of the wide variety of specific embodiments 
provided by the present invention. 

These and other benefits are described throughout the present 
specification. A further understanding of the nature and advantages of the invention 
herein may be realized by reference to the remaining portions of the specification and the 
20 attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figs. 1A-1B illustrate drawings of representative system configurations in 
a specific embodiment of the present invention. 
25 Fig. 2 illustrates a drawing of a representative relationships between paths 

and volumes in a specific embodiment of the present invention. 

Fig. 3 illustrates a drawing of a representative path selection table m a 
specific embodiment of Ihe present invention. 

Fig. 4 illustrates a drawing of a representative path group table in a 
30 specific embodiment of the present invention. 

Fi g. 5 illustrates a flowchart of a representative path selection process in a 

specific embodiment of the present invention. 
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Fig. 6 illustrates a diagram of a representative user interfece in a specific 

embodiment of the present invention. 

Fig. 7 illustrates a diagram of a representative user interlace in a specific 

embodiment of die present invention. 
5 Fig. 8 illustrates a flowchart of representative processing in an 

implementation that uses an expensive network below a particular throughput or busy rate 
in a specific embodiment of the present invention. 

Fig. 9 illustrates a flowchart of representative processing in an 
implementation that uses an inexpensive network during night operations in a specific 
10 embodiment of the present invention. 

Fig. 10 illustrates a drawing of another representative system configuration 
in a specific embodiment of the present invention. 

Fig. 1 1 illustrates a diagram of a representative network monitor message 
in another specific embodiment of the present invention. 
15 pig. 12 illustrates a flowchart of representative processing in an 

implementation that uses a network monitor in a specific embodiment of the present 
invention. 

Fig. 13 illustrates a flowchart of representative processing in an 
implementation that uses an expensive network in emergency situations in a specific 
20 embodiment of the present invention . 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
The present invention provides improved techniques for managing data 
flow over a plurality of connections between primary and remote storage devices. 

Remote copy technology provides mirror image copies of one of a pair of 
disk systems to the other member of the pair. The two disk systems are interconnected by 
ports and located at some distance from one another. The remote copy system keeps a 
' mirror image of disks located in the local, or primary system. The mirror image is stored 
in a remote, or secondary disk system. The local disk system copies data on a local disk 
30 of the pair. When a host updates data on the local system's disk, the local disksystem 
transfers a copy of the data to the remote system through a series of ports and network 
links. Accordingly, no host operation is required to maintain a mirror image of a volume 
in the local system. For further description of representative remote copy systems in the 
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art, reference may be had to a variety of references, such as U.S. Patent Nos. 5,459,857 
and 5,544,347. 

Various types of methods exist for transferring data between the local and 
remote disk systems. In one type, called a "synchronous mode," the local disk system 
5 transfers data to the remote disk system before indicating mat a write request for the data 
from a host is complete. In another type, called a "semi-sync mode," the local disk 
system indicates mat the write request for data from a host is complete and then transfers 
the write data to the remote disk system. In bom of these types of modes, succeeding 
write requests from the host arc not processed until a previous data transfer is indicated to 
10 the host as finished. In an -adaptive copy mode" by contrast, data which is pending copy 
to the remote disk system is stored in a memory in the primary disk system, and 
transferred to the remote disk system when the local disk system and/or ports are 
available for the copy task. Accordingly, disk write operations by the host system to the 
primary system can continue without pause for completion of the copy operation to the 
15 remote storage system. For further description of representative transfer modes in remote 
copy systems in the art, reference may be had to a variety of references, such as U.S. 

Patent No. 5,933,653. 

Figs. 1 A-1B illustrate drawings of representative system configurations in 
a specific embodiment of the present invention. As shown in Fig. 1 A, two storage 
20 systems, which are named a primary storage system 100a and a secondary storage system 
1 00b, comprise one configuration for using a remote storage backup system. Each of the 
primary storage system 100a and the secondary storage system 100b comprise one or 
more volumes that store data. The storage systems 100a and 100b have processors which 
execute programs, and a memory for storing control data and tables for the programs. 
25 During operation, data stored on volumes of the primary storage system 100a is copied to 
identical volumes in the secondary storage system 1 00b. This operation is sometimes 
referred to as "mirroring" or "mirror imaging." For example, information stored on 
volumes 103a and 103b of the primary storage system 1 00a may be mirrored on the 
volumes 105a and 105b of the secondary storage system 100b. The primary storage 
30 system 100a and the secondary storage system 100b may be under the control of a single 
entity, or alternatively, a service provider may own a storage system which is used to 
provide backup services to the owner of the primary storage system 100a. Additionally, 
in some embodiments, the role of primary copy and secondary, or backup copy, may be 



(30) 



2003-32290 



10 



reversed or even shared between the two storage systems. In these embodiments, the 
secondary storage system 1 00b may mirror some of the volumes of primary storage 
system 100a, and the primary storage system 100a may mirror some of the volumes of the 
secondary storage system 1 00b. 

One or more host systems, such as host 130a and host 130b, connect to at 
least one of the primary storage system 100a and the secondary storage system 100b by a 
channel path 131a, and a channel path 131b, respectively. In example specific 
embodiments, channel paths 131a and I3lb are implemented using SCSI, Fibre Channel, 
ESCON, and the like. The host systems 130a and 130b access data stored on the volumes 
103a and 103b in the primary storage system 100a and Ate secondary storage system 
100b, respectively, through channel paths 131a and 131b, respectively. 

Management consoles 120a and 120b connect to the primary storage 
system 100a and the secondary storage system 100b, respectively, by paths 121a and 
I21b, respectively. In an example embodiment, the paths 121 a and 121b may be LAN, 
15 proprietary path, SCSI, Fibre Channel, ESCON, and the like. An administrator inputs 
policies for creating path selection table 102 through management console 120a. 

In a representative specific embodiment, the network 140a is a public, low 
performance, low security, network that Is relatively low in cost to use. In an example 
embodiment, network 140a is the Internet. As used herein, the term "public" is used to 
refer to networks that are accessible by virtually anyone who is certified (or sometimes 
uncertified). The network 140b is a private, high performance, high security network that 
is relatively more expensive to use. In an example embodiment, the network 1 40b is a T3 
communication line. As used herein, the term "private" is used to refer to networks that 
are dedicated to a particular user, or group of users, and that others cannot access. The 
25 term "public" is used to refer to all other networks. 

This present invention is described using simplified representative 
embodiments, in which just two types of networks provide connections between the 
primary storage system 100a and secondary storage system 100b, for clarity. However, 
these simplified examples are intended to be merely illustrative for the purposes of 
30 explanation, rather than limiting of the present invention. In many specific embodiments, 
three or more different types of networks are used In a manner similar to that described 
herein with reference to these specific embodiments. 
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In Fig. 1A, a plurality of channel extenders 110a and 1 10b provide 
protocol conversion between ports, such as ports 101a and 101b, and the networks 140a 
and HOb. For example, if a port 101a is a SCSI type interface, and network 140a is the 
Internet, then the channel extenders 1 10a and 1 10b convert data from the SCSI format to 
5 the TCP/IP protocol, and vise versa. One or more ports, such as ports 101a and 101b. 
connect the primary storage system 100a and the channel extender 1 10a. The channel 
extender 1 10a provides connection to the networks 140. and 140b. Port 101a provides 
connection to network 140a, while port 101b provides connection to network 140b 
through the channel extender 110a. One or more ports I Ola and 102b also connect the 
10 secondary storage system 100b and the channel extender 1 10b. The channel extender 
1 10b provides connection to the networks 140a and 140b. 

Fig. IB illustrates an alternative specific embodiment, in which the 
primary storage system 100a and/or secondary storage system 100b support various types 
of protocols. Accordingly, the respective channel extenders 1 10a and 1 10b are not 
15 required. In this specific embodiment, the ports 101a and 101b in the primary storage 

system 100a connect directly to the networks 140a and 140b using one or more interfaces, 
such as a fibre interface 160a and an IP interface 170a, for example. Analogously, ports 
1 02a and 102b in the secondary storage system 1 00b connect direcdy to networks 140a 
and 140b via fibre interface 160b and IP interface 170b, respectively. 
20 pig. 2 illustrates a drawing of a representative relationships between paths 

and volumes in a specific embodiment of the present invention. As shown in Fig. 2, 
volumes 103a, 103b, 103n within the primary storage system 100a are capable of. 
sending data via one or more path groups, such as path groups 220a, 220b, .... 220m. 
Each path group comprises one or more ports, such as ports lOlaand 101b. that connect 
25 to a network, such as network 140a, for example. In Fig. 2, path group 220a comprises 
port 101a, connecting to network 140a, path group 220b comprises port 101b, connecting 

to network HOb, and so forth. 

A path using policy 210 maps a volume and one or more path groups, and 
defines priority for using paths when transferring data to the secondary storage system 
30 100b. For example in Fig. 2, when the primary storage system 100a transfer data on 
volume 103b to the secondary storage system 100b. It selects a port 10lb in path group 
220a. However, if the path group 220a is not available for some reason, then it selects 
path group 220b. If the path group 220b is not available, then it selects path group 220m. 
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For another example in Fig. 2, a volume 103a is allowed to use paths in only path group 
220a. In a specific embodiment, the path using policy 210 is implemented using tables, 
. as illustrated in Fig. 3 and Fig. 4, which ate described herein. 

Fig. 3 illustrates a drawing of a representative path selection table in a 
5 specific embodiment of the present invention. As shown in Fig. 3, a path selection table 
300maps a volumenumber310. W hichcon-cspondsto a volume,suchasvolumes 103a 

and 103b in Fig. 1. and one or more path group numbers 320a and 320b, which 
correspond to path groups, such as path groups 220a and 220b in Fig. 2, for example. 
The volume number 310 is unique to each volume within a storage system. For example. 
10 the primary storage system 100a. which comprises volumes 1 03a and 103b. will have 
unique volume numbers 310 corresponding to the volumes 103a and 103b in the path 

selection table 300. 

The path group numbers 320a and 320b are unique to each path group 
defined for a storage system. When two or more entries for the path group number exist. 
15 such as 320a and 320b. for example, the number of the entries corresponds to the number 
of different networks connected to the storage system. The preceding path group 
numbers. 320a. have a higher priority than succeeding path group numbers, 320b. When 
transferring data to the secondary storage system 100b, the primary storage system 100a 
selects a path group having a higher priority. For example, in Fig. 3. the path group 
20 number320aha S higherprioritythanpathgrou P number320b. In the second row of 

table 300. when transferring data on volume with number I, primary storage system 100a 
selects a port in path group with number 1 rather than path group with number 0. 

If there are fewer path groups than entries for path groups in path selection 
table 300 then a NULL string is stored in the remaining entries in the path selection table. 
25 For example in Fig. 3. the volume number 0 is allowed to use path group number 0, but 
no other path groups. So, a NULL is stored in the path group number 320b for the 
volume 0. 

• ' ' Fig 4 illustrates a drawing of a representative path group table in a 

. specific embodiment of the present invention. As shown in Fig. 4. a path group table 400 
30 provides information about the path using policy 210. and maps path groups and ports. 
The path group table 400 comprises a path group number 4 1 0. which is a unique number 
assigned to each of the path groups for a particular storage system. A constraint 420 
holds constraints that apply to the use of the paths within the path groups. For example. 
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the constraint 420 stores "Max 5MB/s» for path group 0. Accordingly, the paths in the 
path group 0 must not exceed 5MB/s for transferring date. One or more constraints can 
be registered to aparticular path group. A variety of types of constraints can be used in 
various specific embodiments according to the present invention. Representative 
examples of specific constraints are described herein below. A port number 450a, 430b, 
and 430c each hold a number corresponding to a port in the path group. Each port has a 
unique port number within a storage system 100. 

If there are fewer ports in a path group than there are entries in the path 
group table 400, then a NULL string is stored into the vacant entries. For example, the 
path group number 0 has only two ports, port number 0 and port number 1 . Therefore, a 
MULL is stored In the port number 430c. 

A status 440 holds a current status of a path group. In a specific 
embodiment, the status takes values such as "available," "unavailable » or "temporarily 
unavailable." The status of "available » indicates that the primary storage system 100a 
can use the corresponding port in the path group. The status of "unavailable" indicates 
thattheprimary storage system 100a cannot use the corresponding port. Thestatusof 
"temporarily unavailable" allows the primary storage system 1 00a to attempt to use a path 
group 220 for a certain interval, e.g. once per minute, in order to check availability. For 
example, if constraint 420 comprises "Error rate less than S%» and status 440 shows 
"temporarily unavailable." then data is transferred via the path group 220a once per 
minute, for example. Theprimaiy storage system 100a monitors the results. Whenthe 
error rate Ms below 5%. for example, the primary storage system 100a changes the 

status 440 to "available." 

Fig. 5 illustrates a flowchart of a representative path selection process in a 
specific embodiment of the present invention. As shown in F.g. 5. when a request to 
transfer data to the secondary storage system 100b arises, the primary storage system 
U 100a executes a plurality of steps. In a step 500, the primary storage system 100a selects 

a path group to transfer data to the secondary storage system 100b, by accessing path 
selection table 300. Since primary storage system 100a knows the volume storing data to 
30 be transferred, it detennines a row corresponding the volume in the path selection table 
300 Then, it selects path group number 320a in the first iteration. If the path group 220a 
does not satisfy constraints in a step 520. then the primary storage system 100a selects 
path group number 320b in the second iteration. 
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In a step 520, the path group is examined to determine whether all 
constraints are satisfied. If all path groups listed in the path selection table 300 do not 
satisfy the constraints, then processing proceeds with a step 540. In step 540, the primary 
storage system 100a suspends the mirroring operations between the pair of volumes in the 
primary storage system 100a and the secondary storage system 100b. and reports a 
warning to a user. 

If there is a path group that satisfies the constraints in step 520, then, at a 
step 560. a check whether all ports in the path group are busy is performed. A port is 
busy when the primary storage system 100a is transferring data using the port. If there's 
a port that is idle, then, in a step 530, the primary storage system 1 00a selects the idle 
port, and transfers data through the port. Next, in a step 550. a check is performed to 
determine if the data transfer successfully completed. If the data transfer completed 
successfully, then processing is finished. Otherwise, control proceeds back to step 500, in 
which the primary storage system 100a tries another path group. 
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Constraints 

A variety of types of constraints may be used in specific embodiments of 
the present invention. The following are representative examples of constraints that may 
be used in various specific embodiments. This list is not intended to be exhaustive, but 
rather, illustrative of some of the many different types of constraints that are used in 
various specific embodiments of the present invention. 

A time constraint limits the time when the primary storage system 100a is 
allowed to use a particular path group. For example, if a time constraint of "9:00 P m to 
6 00 am only" is active for a particular path group, and the current time is 8:00 am, then 
25 the primary storage system 100a must not use paths in the particular path group. The 
' primary storage system 1 00a comprises a time clock, which is used to determine if the 
time is within the bounds of a time constraint, if a time constraint exists for a particular 
path group: The primary storage system 100a checks the time clock on a regular basis 
(c g once per minute). When the time constraint is satisfied, the primary storage system 
30 1 00a changes the status 440 to "available - Similarly, when the time constraint is no 
longer satisfied, then the primary storage system 100a changes the status 440 to 
"unavailable." 
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A throughput constraint limits, the maximum throughput that the primary 
storage system 100a is allowed to use from a particular path group. For example, if a 
throughput constraint of »5MB/s" has been set for a particular path group, and the current 
result of monitoring shows a throughput of 5 .3MB/s being used, then the primary storage 
5 systemlOOamustnotusepamsmfteparticularpathgroup. In various specific 
embodiments, processors, hardware, and/or software mechanisms within the prunary 
storage system 100a monitor throughput of each port. In a specific embodiment, 
processors monitor the quantity of data transferred by a particular port during a spectfic 
time interval, such as every second. Then, a sum of the quantities monitored by each 
0 processor is computed. This sum indicated the throughput for foe particular pam group 
comprisingthc ports. When the throughput constraint is satisfied, the primary storage 
S ysteml00achangcsthest a tus440t O «avaaablc." Similarly, when the throughput 
constraint is no longer satisfied, then the primary storage system 1 00a changes the status 

440 to "temporarily unavailable." 
15 TheprimarystoragesystemlOOacontinuestomonitorthroughput,and 

wi Ll set the status 440 to "available" when the throughput 611s below the constraint. In a 
specific embodiment, while the status 440 continues to show that a particular path group 
is -temporarily unavailab.e » the primary storage system 100a selects the particular path 
groupatregularintervals.toperformatrialdatatransfer. Tne primary storage system 
20 100a selects the remaining path groups to perform non-trial data transfers. 

A busy rate constraint limits the maximum "busy rate" that primary 
storage system 100a is allowed to use a particular path group. As used herein, the term 
••busy ra te" refers to a percentage of total capacity of a network line which is being used 
to carry traffic. For example, if a busy rate constraint of "70%" has been set. and the 
current monitoring results indicate that a particular path group is 75% busy, then the 
primary storage system 100a must not select new paths in that particular path group. In 
various specific embodiments, processors, hardware, and/or software mechanisms wtthm 
•• the primary stomge system IWa mom 

embodiment, processors monitor the time that each port is used to transfer data dunng a 
30 specific interval, such as every second. Then, a sum of the time determined by 

monitoring each port is computed. This sum indicates the busy rate for the particu.ar path 
group comprising the ports. When the busy rate constraint is satisfied, the prunary 
storage system 1 00a sets the status 440 to "available." Similarly, when the busy rate 
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constraint is no longer satisfied, then the primary storage system 100a ehanges the status 

440 to "temporarily unavailable." 

The primary storage system 100a continues to monitor busy rate, and wfll 
set the status 440 to "available" when the busy rate fells below the constraint In a 
specific embodiment, while the status 440 continues to show that a particular path group 
is "temporarily unavailable - the primary storage system 1 00a selects the particular path 
group at regular intervals, to perform a trial data transfer. The primary storage system 
100a selects the remaining path groups to perform non-trial data transfers. 

An error rate constraint limits the maximum error rate that the pnmary 
storage system 100a is allowed to use a particular path group. For example, if the error 
rate constraint of "10%" has been set, and the current results of monitoring indicate that 
an error rate of 15% is present in a particular path group, then the primary storage system 
1 00a must not select new paths in that particular path group. In various specmc 
embodiments, processors, hardware and/or software mechanisms within the pnmary 
storage system 100a monitor error rate of each port. For example, processors count the 
total number of transfers and the total number of errors for a port daring a specific tune 
interval, such as every minute. Then the sum of these results for each port is computed. 
Iha sum indicates the total number of transfers and errors. Dividing the total errors by 

the total transfers shows the error rate. 
0 The primary storage system 100a continues to monitor the error rate, and 

will set the status 440 to "available" when the crmr rate falls below the constraint Ina 
specific embodiment, while the status 440 continues to show that a particular path group " 
is "temporarily unavailable." the primary storage system 100a selects the particular path 
group at regular intervals, to perform a trial data transfer. The primary storage system 
15 100a selects the remaining path groups to perform non-trial data transfers. 

An outboard constraint limits the selection of paths by the primary storage 
system 100a based upon information about the availability of path groups provided by 
Onanisms outside of the primary storage system 100a. For example, a network mon.tor 
that monitors network 1 40a, is connected to the management console 120a, and sets the 
30 availabilityoftheprimarystoragesystemlOOavlamanagementconsoleUOa. The 

network monitor monitors, for example, a busy rate, a number of routers that are out of 
service, an error rate, a rate of packet loss, a collision rate of packets, and the like. If the 
network monitor finds abnormal conditions, then it informs the primary storage system 
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100a, which sets the status 440 to '-unavailable" until the network 140a becomes 

available. . 

Another example of an outboard constraint is intervention by a user. For 

example, users may temporarily make network 140a unavailable to perform routine 
maintenance, and the like, for example. Before performing maintenance, the user sets the 
status 440 to "unavailable" for the network 140a in the primary storage system 1 00a using 
the management console 120a. After completing the maintenance, the user sets the status 

440 to "available" once again. 

Figs. 6 and 7 illustrate diagrams of a representative user interface in a 
specific embodiment of the present invention. In order for users to apply constraints to 
networks traffic, users need to be able to provide constraint information to the primary 
storage system 100a. As shown in Fig. 6, a management window 600 provides a user 
interface to a user at the management console. When a user clicks a management icon, 
the management window 600 is displayed on the management console to the user. A 
l5 serverbox610showstherelationship between serversand volumes. In the example of 
Fig 6 meservernamed«Juno»hastwovolumesnamed"/dev/rdsk/cltldO»and 
«/dev/niskfclt2d0.» If a user selects one of these volumes, then the device infonnation 
box 620 appears. As shown in Fig. 6. the device information box 620 shows the 
information for the device «Vdev/rdsk/clt2dO." The device information box620 provides 
20 storage system information 630, device information 640, and remote copy informal 
65 0 in the remote copy information 650. a pair status 65 1 shows whether the volume „ 
mi „ ored or «* and its status if it is being mirrored. The PAIR status in F,g. 6 indues 
that the primary and secondary volumes are mirrored. 

The remote storage system infonnation includes a serial 652, which 

25 indicatesmeproductserialnumb^ , 
which indicates the location of the paired storage system. When a user clicks the triangle 
button corresponding to the serial 652, infonnation about the available storage systems 
connected to the local stomge system described in the storage system information 630 is 

shown. ' „ , 

30 The port information includes a path group 654, which shows all path 

groups defined to the local storage system, and their status. If a path group does not 

connect to the selected remote storage system, then the status shows «N/A - If * is 

connected end available to use. then the status shows "RDY." The order from top to 



(38) 



&m 2003-32290 



17 



10 



15 



20 



bottom implies priority for use ofthe path group. For example, in Fig. 6. the path group 
«T3 up to 5MB/s" has the higher priority than "Internet," and the primary storage system 
100a selects "13 up to 5MB/s» when transferring data to the secondary storage system 
100b. A user can change this order using this user interface. 

When a user selects one of path group from the path group 654, then 
information for the selected path group appears in a change path group name 655, a status 
field 656, and a constraints field 657. A user can input a new name into the change path 
group name 655 in order to changethe name. The status field 656 shows detailed status 
for the selected path group. The status can be one ofthe statuses of "available." 
"unavailable," or "temporarily unavailable," which have been described hereto above. 
Note that if a user selects "unavailable," then the primary storage system 100a does not 
use the path group for transferring the data on the volume. 

Many kinds of constraints fox the selected path group can appear in the 
constraints field 657 in various embodiments ofthe present invention. When a user clicks 
the triangle button corresponding the constraints field 657, the constraints for the selected 
path group are displayed. Ifa constraint is applied to the path group, a check marie ,s 
shown on the !ert ofthe constraint, as shown in F,g. 6. If a user elects one of the 
constraints shown, then an appropriate window appears (not shown in Fig. 6). For 
example, if the user selects the «TP up to 5 MB/s" constraint shown in Fig. 6, then a 
window 700 inustratedbyFig.7^^^ 

700 the user can input necessary information to set a throughput constraint, for example. 
When the user clicks an apply button 750. then the constraint information set up by the 
user is read and applied. Clicking a clear button 760 clears the current constraint 
information, causing the check mark icon in the constraints field 657 to disappear The 
25 user fills in the necessary information usingthe management window 600 mFig. 6. 

When, the user clicks an apply button 660. the constraint information input by theuser is 
read and applied. The information is applied by the primary storage system 100a.wh.ch 

to the constraint information entered by the user. Further, the management console 120a 
30 maps a path group name entered by the user in the path group field 654 into a set of port 
numbers, and translates the path group name to the port numbers. For example, the path 
group »T3 up to 5MB/S" is translated to a port 0 and a port 1 . Then, the management 
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console 120a sends the port numbers along with a volume number and constraints to the 
primary storage system 100a. 

Implemen tation Examples 

The present invention wilt next be described with reference to examples of 
using some of the various functions and features of various specific embodiments thereof. 
This section is intended to be merely illustrative of some of the many ways that specific 
embodiments of the present invention can use constraints as described herein above. 
Note that these examples use only two networks of differing types, such as an expensive 
network and an inexpensive network, for clarity of explanation. However, as is apparent 
to those skilled in the art, many different configurations may be readily prepared using a 
variety of network types in accordance with various specific embodiments of the present 



invention. 



Fig. 8 illustrates a flowchart of representative processing in an 
15 implementation that uses an expensive network below a particular throughput or busy rate 
in a specific embodiment of the present invention. In the example implementation shown 
in Fig. 8, an expensive network is used if throughput or busy rate is below a maximum 
throughput or busy rate. When a user sets the "throughput constraint" for an expensive 
network as described herein above, the use of the expensive network is kept below the 
20 maximum throughput Further, if the user sets the "busy rate constraint" for the 

networks, then he can use the networks below the maximum busy rate. This example 
implementation is representative of a situation in which users are allowed to use 
expensive networks under a certain data throughput. When the maximum throughput is 
exceeded, the users may incur additional charges, or network performance may 

25 significantly degrade. 

The flowchart in Fig 8 shows the constraint strategy which a user 
configures using the management console 120a in order to cause the primary storage 
system 100a to use an expensive network below a maximum throughput or busy rate, but 
use an inexpensive network for traffic if the throughput or busy rate exceeds the 

30 maximum specified in the constraint. In a step SOO. using the user interface described in 
Fig. 6 and Fig. 7. the user makes the expensive network available up to predetermined 
maximum throughput, and gives the expensive network the first priority. Then, in a step 
810, again using the user interface described in Figs. 6 and 7. the user makes the 
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inexpensive network available without constraint, and gives the inexpensive network the 
second priority. After the user has configured the constraint strategy according to the 
above steps, the primary storage system 100a transfers data to the secondary storage 
system 100b, according to the flowchart in Fig. 5. As previously described herein above, 
and with reference to Fig. 5. the primary storage system 100a selects an expensive 
network for sending traffic until the preset maximum throughput is reached Once the 
maximum throughput is reached, the primary storage system 100a selects the inexpensive 
network since the expensive network no longer satisfies the constraint. Similarly, the 
user can set a busy rate constraint in step 800, as well. 

Fig. 9 illustrates a flowchart of representative processing in an 
implementation that uses an inexpensive network during night operations in a specific 
embodiment of the present invention. In the example implementation shown in Fig. 9, an 
inexpensive, public network is used during ni^itthne operations. This example 
implementation is representative of a situation in which users are allowed to use public 
networks during nighttime, but avoid daytime public network access. Because public 
networks tend to have high traffic in the daytime, and transferring remote copy data 
through the public networks affects other services, like e-mails and web access, the user 
restricts use of the public network only to nighttime operations. In order to avoid using 
the public network during <Uytime operations, the user sets a 'time constrainf for the 
public network. For example, the user may set a time constraint of "9:00 am to 9:00 pm" 
in order to prohibit the primary storage system 1 00a from using the public network. 

The flowchart in Fig. 9 shows the constraint strategy which a user 
configures using the management console 120a in order to cause the primary storage 
system 100a to use inexpensive networks during nighttime. In a step 900, using the user 
interface described in Fig. 6 and Fig. 7, the user makes the inexpensive networks 
available only for nighttime (e.g. 9:00 pm to 6:00 am) use, and gives the inexpensive 
networks first priority. Then, In a step 910, again using the user interface described in 
Figs. 6 and 7, the user makes the inexpensive networks available without constraint, and 
• gives the inexpensive networks second priority. After the user has configured the 
constraint strategy according to the above steps, the primary storage system 100a 
transfers data to the secondary storage system 100b, according to the flowchart in Fig. 5. 
As previously described herein above, and with reference to Fig. 5, the primary storage 
system 100a selects an inexpensive network for sending traffic from the time period 
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during 9:00 pm to 6:00 am. At other times, the primary storage system 1 00a selects the 
expensive network since the inexpensive network no longer satisfies the constraint. 
Similarly, the user can set a busy rate constraint in step 900, as well. 

Fig. 10 aiustrates a drawing of a representative system configuration in 
5 another specific embodiment of the present invention. In the example implementation 
shown in Fig. 10, the primary storage system 100a uses an inexpensive network except in 
case of an emergency. This example implementation is representative of a situation in 
which users subscribe to expensive networks on a pay per use basis. There are many 
different types of emergency cases that may be detected and responded to in various 
10 specific embodiments of the present invention. A brief sample of representative 
emergency cases will be described here. For example: 

(1) When the inexpensive networks have high traffic and the primary 
storage system has a great deal of pending data. When an external network monitor that 
monitors traffic over the networks observes high traffic in the inexpensive network, the 

15 network monitor notifies the primary storage system 100a. Then the primary storage 

system 100a diverts traffic to other networks until the external network monitor indicates • 
that the traffic in the inexpensive network has diminished. 

(2) When the primary storage system has too much pending data. 
Generally, an inexpensive network is slower than an expensive network. So, data to be 

20 transferred to the secondary storage system accumulates in the primary storage system 
until there is sufficient network bandwidth available to move the accumulated data to the 
secondly storage system. If the inexpensive network continues to be slow, the primary 
storage system can. upon detecting this condition, switch to using amore expensive, and 
faster, network to send the accumulated data to the secondary storage system. In orderto 
25 avoid a situation where the accumulated data makes it no longer possible to maintain a 
mirror image copy of the primary storage system data at the secondary storage system, 
the primary storage system monitors how much pending data has accumulated, and uses 
the more expensive, and faster, networks when the accumulated data exceeds a threshold. 

(3) " When errors exceed a threshold. The primary storage system 
30 monitors how many errors have occurred in transferring data through the networks and 
calculates an error count, which may be a percentage, for example. The primary storage 
system switches to a more expensive network when the error count for the inexpensive 
network exceeds a threshold. The threshold may be provided by a customer. While using 
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expensive networks, the primary storage system 100a sends some data over the 
inexpensive network at regular intervals, to perform a trial data transfer. The primary 
storage system 100a selects the remaining path groups to perform non-trial data transfers. 
The primary storage system 1 00a ceases using the expensive networks if the error count 
5 for the inexpensive networks falls below the threshold. This technique is useful in 
specific embodiments in which a TCP/IP protocol network is used as the inexpensive 
network transferring protocol, because a high degree of errors in such TCP/IP networks 
often Indicates a high volume of traffic in the network. 

(4) When errors occur. The primary storage system monitors for the 

10 presence of errors that occur in transferring data through the networks. The primary 
storage system uses an expensive network as an alternate paih for an inexpensive 
network, and switches to the expensive network when an error is detected in the 
inexpensive network. This technique is useful in specific embodiments in which the 
primary storage system first attempts to transfer data via the inexpensive network. If this 
15 fails, the primary storage system uses the expensive network. 

As shown in Fig. 10, two storage systems, the primary storage system 
100a and the secondary storage system 100b. comprise one configuration for using a 
remote storage backup system. A network monitor 1000, connects to network I40a and 
network 140b, and management console 120a. The network monitor 1000 monitors 
20 activity in networks 140a and 140b. A path 1020 connects the network monitor 1000 to 
networks 140a and network 140b. A path 1010 connects the network monitor 1000 to the 
management console 120a. A path 1020 and a path 1010 may be parts of the same 
network, such as the Internet, for example. If the network monitor 1000 detects a high 
traffic volume in network 140a, then the network monitor 1 000 sends a message to the 

25 management console 120a. 

Fig. 11 illustrates a diagram of a representative network monitor message 

in another specific embodiment of the present invention. In the representative message 
' format illustrated by Fig. 11,'a network n^ 

registered in the path group 654 in Fig. 6. For example, a network name of "T3 up to 
30 5MB/S" or "Internet" can be used. One purpose for the network name 1 100 is to make 

the network identifiable by the management console 120a. A warning 1110 shows a type 
of warning that the nerwork monitor 1000 discovered while monitoring the network. A 
variety of different types of warnings can be used in various specific embodiments of the 
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present invention. For example, in a specific embodiment, warnings for "Overload" and 
"Change to Normal" are provided. An "Overload" warning indicates that the network 
monitor 1000 Found an overload condition within the network being monitored. An 
"Overload" warning includes a current busy rate that the network monitor 1000 
5 determined during monitoring the network. A "Change to Normal" warning indicates 
that the network monitor 1 000 found a network 140a has returned to a traffic volume 
level lower than athreshold busy rate. A current date and time field 1120 indicates a time 
when the network monitor 1000 issued the message to the management console 120a. 
Fig. 12 illustrates a flowchart of representative processing in an 
]0 implementation that uses network monitor in a specific embodiment of the present 

invention. In the example implementation shown in Fig. 12, the network monitor 1000 
performs steps 1200 to 1230, and the management console 120a performs steps 1240 to 
1260. In a step 1200, the network monitor 1000 monitors networks for a change in 
situation, such as a load change, an emergency, and the like. If a load situation change is 
15 detected by step 1200, then, in a decisional step 1210, a determination is made whether 
■ the change is from normal to overload. If the situation change is from normal to overioad 
then, in a step 1220, the network monitor 1000 stores "Overload" into the warning field 
1 1 1 0 of a message having a format such as the message format described herein above 
with reference to Fig. 1 1, and sends the message to the management console 120a. 
20 Otherwise, if in step 1210 it is determined that the situation changed from overload to 
normal, then in a step 1230. the network monitor 1000 stores "Normal" into the warning 
field 1 1 1 0 of the message, and sends the message to the management console 120a. 

In a decisional step 1240, responsive to receiving the message sent by the 
network monitor 1000, the management console 120a checks the warning field 1110, to 
25 see if the warning field 1 1 10 stores an "Overload" or a "Normal" condition type. If the 
warning field 1110 stores an "Overload," then, in a step 1230, the management console 
120a sets the status 440 for the network to "temporarily unavailable" in the path group 
table 400. Otheiwisc, if in step 1240, it is determined that the warning 1 1 10 stores an 
"Normal," then in a step 1260, the management console 120a sets the status 440 for the 
30 network to "available." As described herein above with reference to the flowchart in Fig. 
5, the primary storage system 100a will avoid using a network having a status 440 of 
"temporarily unavailable" or "unavailable." Accordingly, the networks that the network 
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monitor 1000 determines are overloaded will not be selected by the primary storage 
system 100a. 

Fig. 13 illustrates a flowchart of a representative processing in an 
implementation mat uses an expensive network in emergency situations in a specific 

5 embodiment of the present invention. In the example implementation shown in Fig. 13, 
an inexpensive network is used if the workload situation is normal. When a user sets the 
error rate and outboard constraints for the inexpensive network as described herein, the 
use of the expensive network is reserved only for emergencies. This example 
implementation is representative of a situation in which users are allowed to use 

1 0 expensive networks only to deal with emergency situations. When the error rate 

constraint is exceeded, the network performance may be significandy degraded, causing 
T ) the secondary storage system to be incapable of preserving a mirror image of the primary 

storage system. In a step 1 300, the network monitor 1 000 is configured to monitor 
inexpensive network 140a. A predetermined threshold for workload for the network 140a 

15 is configured using the user interface described above with reference to Figs. 6 and 7. 
Once configured, the network monitor 1000 performs the processing described above 

with reference to Fig. 12. 

In a step 1310, using the user interface described in Fig. 6 andFig. 7, the 
user makes the inexpensive network 140a available with an error rate constraint, such as a 
20 predetermined threshold for the error rate, for example, and an outboard constraint, and 
gives the inexpensive networks first priority. The outboard constraint causes inputs from 
the network monitor 1 000 to be reflected to the path group table 400 in the primary 
storage system 100a, as described herein above with reference to Fig. 12. In a step 1320, 
the user makes the expensive network 140b available without a constraint, and gives the 
25 expensive network second priority. Using this constraint strategy, the primary storage 
Qj system 100a selects the inexpensive network 140a, so long as Ihe network monitor 1000 

determines that there are no overloads or emergency conditions in the inexpensive 
network 140a." If an overload is detected by the network monitor 1000. this information is 
forwarded to the management console 120a, which reflects this condition in the status 
30 field 440 for the inexpensive network 140a in the path group table 400. A change to the 
status field 440, causes the primary storage system 1 00a to alter its selection of networks, 
by choosing the expensive network 1 20b until the overload situation in the inexpensive 
network 140a is relieved. 
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The preceding has been a description of the preferred embodiment of the 
invention. It will be appreciated that deviations and modifications can be made without 
departing from the scope of the invention, which is defined by the appended claims. 
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What is claimed is: 



1 1. A storage system apparatus, comprising; 

2 at least one of a plurality cf disk drives; 

3 a memory, operable to contain path selection information; 

4 a plurality of ports, providing switch-able connection to a plurality of 

5 networks; and 

6 a processor; 

7 wherein said plurality of networks each has at least one of a plurality of 



g user provided policies associated therewith, and wherein said processor, based upon 

9 monitoring of at least one of a plurality of conditions in said plurality of networks, selects 

10 at least one of said plurality of ports connecting said plurality of networks, based upon a 

1 1 comparison of said at least one of a plurality of conditions in said plurality of networks to 

12 a plurality of user provided policies. 



1 2. The storage system apparatus of claim I , wherein said at least one 

2 of a plurality of conditions comprises at least one of a throughput, a busy rate, an error 

3 rate, and a presence of an error. 

1 3 . The storage system apparatus of claim 1 , further comprising a 

2 plurality of status indications, said plurality of networks each having at least one of said 

3 plurality of status indications associated therewith; and wherein said processor determines 

4 based upon said status indication whether to select a port from said at least one of a 

5 plurality of ports connecting said plurality of networks. 

1 4. The storage system apparatus of claim 3, further comprising a 

2 network monitor, said network monitor operable to detect a condition within at least one 

3 of said plurality of networks, and thereupon set said value in said starus indication. 

1 5. The storage system apparatus of claim 3, wherein said status 

2 indication comprises at least one of available, temporarily unavailable, and unavailable. 

1 6. The storage system apparatus of claim 1,. wherein said policy 

2 comprises at least one of a threshold, a maximum, a minimum, an average, a mean, a 

3 limit, a constraint, a priority, and a target 
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1 7, The storage system apparatus of claim 1, wherein said plurality of 

2 networks are grouped into a plurality of path groups, wherein said policies are associated 

3 with networks in a particular path group. 

1 8. The storage system apparatus of claim 7, wherein said at least one 

2 of a plurality of disk drives comprises at least one of a plurality of volumes. 



1 9. The storage system apparatus of claim 8, wherein each of said at 

2 least one of a plurality of volumes is permitted to access networks of at least one of said 

3 plurality of path groups. 

1 10. A method for minimizing cost of network access by a storage 

2 apparatus, said method comprising: 

3 specifying a first network to be used for transferring data; 

4 specifying a constraint for said first network; 

5 specifying a second network to be used for transferring data; 

6 transferring data using said first network when conditions in said first 

7 network are in accordance with said constraint, otherwise transferring data using said 

8 second network. 

1 11. The method of claim 1 0, further comprising: 

2 transferring a portion of said data using said first network even when 

3 conditions in said first network are not in accordance with said constraint as a test; 

4 monitoring conditions in said first network during said test and 

5 . returning to transferring data using said first network when said test 



6 reveals that conditions in said first network are again in accordance with said constraint 

2 12. The method of claim 10, wherein said first network is relatively 

2 less expensive to use than said second network. 

1 13. The method of claim 10, wherein specifying said constraint for said 

2 first network comprises specifying at least one of a throughput, a busy rate, an error rate, 

3 and a presence of an error. 

1 14. The method of claim 10, wherein said first network is a public 

2 network and said second network is a private network. 
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1 15. The method of claim 10, further comprising: 

2 making said first network a higher priority network than said second 

3 network. 

1 16. The method of claim 1 0, further comprising: 

2 detecting an abnormal condition in said first network and thereupon 

3 transferring data using said second network. 

1 17. A method for selecting a network, said method comprising: 

2 monitoring at least one of a plurality of conditions in a plurality of 

3 networks; 

4 comparing said at least one of a plurality of conditions in said plurality of 

5 networks to at least one of a plurality of user provided policies; and 

6 selecting at least one of a plurality of ports connecting to said plurality of 

7 networks; 

g wherein said plurality of networks each has at least one of said plurality of 

9 user provided policies associated therewith. 

1 18. The method of claim 17, wherein selecting at least one of a 

2 plurality of ports connecting to said plurality of networks comprises: 

3 determining based upon a status indication whether to select a port from 

4 said at least one of a plurality of ports connecting said plurality of networks. 

j 19. The method of claim 1 7, further comprising: 

2 associating said plurality of networks with a plurality of path groups; 

ff_ J 3 wherein said at least one of a plurality of policies is associated with at least 

4 one of a plurality of path groups. 

y 20. The method of claim 17, wherein monitoring at least one of a 

2 plurality of conditions in a plurality of networks comprises: 

3 using a network monitor to detect a condition within at least one of said 

4 plurality of networks, and thereupon set a value in a status indication. 



I 



(49) 



&m 2003-32290 



Iffl 1 A3 



FiglA 



^_13Q fa ^ 120b 




100a 



[01 B] 



Fig 13 




— 100b 

100a 



(50) 



**BB 2003-32290 



Cf22 1 

Fig 2 



Pafr Using Poiicy 




Fig 3 paSh sslsc^oniabls 30C 



G 









Volume number 


Path group 
number 




0 


0 


NULL 


1 


I 


0 


2 


0 


NULL 


3 


i 


NULL 


4 


1 


0 



(51) 



#ISJ 2003-32290 



Fig 4 pafe croup tehis 4C0 



Path group 
number 


Constraint 




Remote link 
number 


Rcratc link 
number 


Rsmcis link 
number 


0 


Ma* 5\£E/s 


Up-available 


0 


I 


HULL 


1 


9:0<}pra to 6:00 zin only 


Available 


2 




4 


2 


Busy rsis less 713% 


Available 


5 


6 


NULL 


3 


Error rate less ihan 5% 


Temporally 
Unavailable 


7 


3 


NULL 


4 


Outboard control 


Tersparaliy 
Unavailable 


5 j 10 


11 



&M2 003-32290 



Fig 5 path selecting algorithm 



O 



Start 



•500 



Select next path groii? 
220 



T 



<AI1 path groups £re > ^ 
examined? yf Yes 




No 



Constraints 



No 



Yes 



AH ports in the path 
group are busy? 

No 



►530 



Select an idle port and 
transfer data 




550 



Data transfer 
successfully 



etcs? 



Yes 




540 



SiEspsnd pairs sad report 
-warning 



1#M 2003-32290 
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Fig 12 FlowcJisrt for reonitoriag networks 
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Fig 1 3 Flow chsrt for using expansive network only in emergency 
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Path Selection Methods for Storage Based Remote Copy 



ABSTRACT OF THE DISCLOSURE 
The present invention provides techniques for managing data flow over a 
plurality of connections between primary and remote storage devices. In a representative 
example embodiment, when the primary storage system copies data to the secondary 
storage system, it chooses one of a plurality of networks connecting it to the secondary 
storage system, depending upon a users' policy. Since networks have different 
characteristics, in terms o£ for example, performance, security, reliability, and costs, the 
user can specify which networks) are used under various circumstances, ix., daytime 
operation, nighttime operation, normal operation, emergency, and so forth. The storage 
systems comprise a mapping of volumes and ports. When performing copy operations, 
the primary storage system finds a volume storing the data, and available ports by 
accessing the mapping. The mappings are based upon policies that are input by a user. 
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devices. 

SOLUTION: In a representative embodiment, when a primary storage 
system copies data to a secondary storage system, it chooses one of a 
plurality of networks connected to the secondary storage system, 
depending upon a user's policy. Since the networks have different 
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